Off-line foveated video: Effects on compression and perception
نویسنده
چکیده
Off-line foveation is a technique to improve the compression efficiency of digitized video. The general idea behind off-line foveation is to blur video regions where no, or a small number of previewers look without decreasing the subjective quality for later viewers. It relies on the fact that peripheral vision is degraded compared to central vision, and the observation that during freeviewing humans' gaze positions generally coincide when watching video. In this talk, we investigate in two experiments the perceptual effects off-line foveation has on 15 subjects when free-viewing, and on 17 subjects when evaluating the quality of six different video clips. The perceptual parameters describe how offline foveation affects where the subjects gaze, the inter-subject dispersion, fixation duration, saccade amplitude, and experienced quality after one, two and three consecutive viewings. Results show that, despite large data reductions when encoded with H.264, off-line foveated videos essentially do not influence the subjective quality of the tested video clips, nor do they change subjects' viewing behavior. In view of these results, we discuss the usage of off-line foveated video in practical applications. Biography: Marcus Nyström received his M.Sc. in Vehicle engineering from the Royal Institute of Technology, Stockholm in 2003. Since then he has been pursuing a PhD at the Department of Information Technology at Lund University, Sweden. His research interests span image and video coding, eye-movements and scene perception. Department Host: Jerry D. Gibson
منابع مشابه
Foveated video quality assessment
Most image and video compression algorithms that have been proposed to improve picture quality relative to compression efficiency have either been designed based on objective criteria such as signal-to-noise-ratio (SNR) or have been evaluated, post-design, against competing methods using an objective sample measure. However, existing quantitative design criteria and numerical measurements of im...
متن کاملVery low bit rate foveated video coding for H.263
Recently, foveated video has been introduced as an important emerging method for very low bit rate multimedia applications [1][2]. In this paper, we develop several rate control algorithms, and measure the performance of foveated video. We utilize H.263 video, and compare the performance with regular video based on the SNRC (signalto-noise ratio in curvilinear coordinates). In order to maximize...
متن کاملMotion Estimation and Compensation of H.263 Video via Foveation
The human visual system (HVS) samples the external world non-uniformly. Utilizing this property in video compression, more bits can be allocated around the point of xation, i.e. the foveation point, to produce low bit rate foveated video. For the same bit rate, foveated video will have higher subjective quality compared to unfoveated video for a single observer. Utilizing the foveation property...
متن کاملFoveated video compression with optimal rate control
Previously, fovcated video compression algorithms have been proposed which, in certain applications, deliver high-quality video at reduced bit rates by seeking to match the nonuniform sampling of the human retina. We describe such a framework here where foveated video is created by a nonuniform filtering scheme that increases the compressibility of the video stream. We maximize a new foveal vis...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007